Papers with minimum Bayes risk
TableMBR: Minimum Bayes Risk Table Generation Based on Structural Consistency (2026.acl-srw)
Copied to clipboard
| Challenge: | Experimental results show TableMBR outperforms the baseline, achieving relative improvements of up to 15% in F1 on Rotowire and 23% in accuracy on LiveSum. |
| Approach: | They propose a text-to-table task that generates structured data from unstructured text . they propose 'tableMBR' that maintains structural consistency through minimum Bayes risk decoding . |
| Outcome: | The proposed method outperforms the baseline and achieves relative improvements in F1 and LiveSum. |
An Empirical Study of Translation Hypothesis Ensembling with Large Language Models (2023.emnlp-main)
Copied to clipboard
| Challenge: | Large language models (LLMs) are becoming a one-fits-many solution, but they sometimes hallucinate or produce unreliable output. |
| Approach: | They propose to use several LLMs to ensemble translation hypotheses . they use instruction tuning, quality-based reranking, and minimum Bayes risk (MBR) decoding to improve translation quality. |
| Outcome: | The proposed method improves translation quality and instruction tuning improves the quality of the output. |
PEAR: Pairwise Evaluation for Automatic Relative Scoring in Machine Translation (2026.acl-long)
Copied to clipboard
| Challenge: | PEAR is a supervised quality estimation metric that reframes reference-free machine translation evaluation as a graded pairwise comparison. |
| Approach: | They propose to use a supervised quality estimation metric family to reframe machine translation evaluation as a graded pairwise comparison. |
| Outcome: | The proposed metric outperforms strictly matched single-candidate QE baselines on the WMT24 meta-evaluation benchmark. |